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<rhe purpose of this investigation vas .to exanine the 
interactive effects of prior aatheiatios preparation and 
instructional 'Method on achieveaent in an intrpductory calculus 
course taujght by both Personalirzed Systea of Instruction (PSi) and 
conventional approaches* Subjects vere 248 university students^ 60 
ftoa the self-paced method and 468 troM the conventional aethod.^ 
Prior tp the course all subjects completed the (Tatheaatics Placement 
Exaaination (APE) • The results of the aultiple regression a*qalysis 
indicated significant effects due to bot^h level of prior aatheaatics 
preparation and instructional aethod:'and aj^o a significant prior 
aatheaatics preparation x instructional aetho<l interaction. 
Suppleaentary analysis indicated tbat< the range of IIPE scores fo^r 
vhidh statistically significant differences in achieVeaent scores 
eaisted was from 5 ta 18. (VBCl 
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PREFACE - ■ . 

•This is the second of two reports in th6 evaluation of Self -Paced 
Calculus during the 1975-76 academic year. The first report compared the 
self -paced, and conventiona.lly taugh(\sections of Mathematics 295 -fn terms of 
student attitudes toward instruction arid end-of-semester examination achievement. 
The findings of - that report indicated significantly'more posilfive attutudes 
toward the course as well as a significantly higher level of examination perform- 
ance by students in the self-paced sections. The pu^^pose of the study' outlined 
•tn ttiis reporl wa^ to extend the investigation of differential examination 
achievement by determining-yhether the/plifferences noted between the self-paced 
and conventional instructional methods were constant fpr alf levels of prior 
mathematics preparation. 

The report is divided into two parts. The first is a capsule summary 
of the method eml^loyed ahd Tthef major findings. The second part is a fuller and 
considerably more detailed version of the study. 



PART I 

^ CAPSULE SUMMARY OF 
METHOD AND RESULTS ; 

A considerable body of research has depionstrated the effectiveness of 
the Personalized System of Instruction (PSI) or *the "J^elT^ Plan" in improving 
students* attitudes toward a course, as well as in prod(Jcing statistically- 
significant gains in student aichijevement. One problem with most of this 
research, however, is that it treats comparative student performance in PSI 
and conventional courses globally. As a result^ the p^res^ncT of interactions 
between instructional method and learner traits and/or aptitudes may be 
masked. The purpose of this invjestigation was> to examine the interactive 
Effects of prior mathematics preparation and instructional method on achieve- 
ment in an introductory calculus course taught by both PSI and corivehtional 
approaches. - - ^ • 

METHOD 

Course and Treatments ' 
The focus of the study was the first semester of a four-semester .intr:o- 
' ductory calci^lus' sequence (Math 295) iritendel for po'^eritial science aend * * 
mathematics majors. A number of sections were offered, to students in a . . 
modified PSI format (entitled Self-Paced Calculus') which allowed for self- 
pacing, variable credit, optional attendance at lecture/problem solving sejs^to 
scheduled tutorials Vor individual help and^testing, and required mastery of 
a unit of material before proceeding to subsequent units. The conventional 
method consis"ted of three hours of lecture/problem solving sessions per week. 
Approximately 24 students were- assigned to ea,ch class section.. The classes • 
were' taught "by both full-time faculty 'and graduate teachijrig assistants.^ 

Subjects ^ 

The subjects in the study'^were 248 students, 60 from the self-paced 
method and 188 from, the conventional method. Since all students who took the 
final* ejcamination^ in the self-paced method earned a semeste> grade of C or 
, above (the re^t bjjng "drops" of F*s), students receiving a D or F in the 
conventional sections werfe eliminated .from^ the analysis. 
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Variables . ' . 

In order to study ttrg interaction between student trait^ aad Instructional 
methods without confounding the effects of the method^ one needs to measure 
• > s^ent traits prior to, or at the very beginning of, the 'course of instruction. 

.-.Prior to beginning *Math 295 each, student in the study had completed the 
. Matheniatics Placement -Examination (MPI). the MPE is a 33-it^ test which ; 
measures prior mathematics- preparation,. defining this construct as encompassing 
both aptitude and achievelnent. 

^ The dependent yariable*- (course achievement) was an eight-item, 132-point, 
* """^ccimmon e%-of- semester examination which covered the equivalent in content 
, 1^ ttie first eight units, or two^credit hours, of.^terial in the self-paced^ 

.method. The test was constructed jointly by faculty .members in both methods and 
' 'scored .by six independent judges wtio had no association with either the self- 
■ paced or conventional sections. Each judge scored ^nly one part of the test 
for each student- and was u.naware of which instructional method any particular 
student was' in. Students took the ex^imination during the regular final 
examination period: ' * . . ^ ^ 

Design and Statistical Ajpalysis . . ' • 

A Because the self-paced altfernative presented students with- a dramatically > 

different learning format from conventioilal methods, faculty were opposed to 
students' being assigned tb.it on the basis of chance. This prevented the 
random assignment of subjects to treatments and led to the adoption oT a quStsi- ♦ 
experimental appro?ich. Quasi-experimental designs do not perm^it the same 
' decree. t)f causal inference as true experiments. The present design was con- ^ 
• ' siderably strengjthened, however, by the demonstration of pre-treatment equ.i valence 

between the tw^nstructional methods in MPE scores and a- range of persorlali'ty , 
, dimensions whi6l^ included level of personal motivation. 
• '\ Subsequent to a preliminary analysis which indicated that the relationship 

between MPE scores and semes.ter examination scores for e^ch instructional 
method was^ tine^ir in nature^ a' multiple, regression analysis was performed with.- 
^ semester examination stores as the predicted variable. The predictor variables^ 
• were Instructional method, MPE scores, and an ""Tt^er action vector creafted by 
multiplying each student's instructional method, by his or her MPE sccJre. , The 
' " critical level of significance fjor all statistical tests was set at the .01 . 

4 

' ^level . . 
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RESULTS ^ • - • 

The results of thS multiple regression- a'nalysis inj|[1cated significant » 
effects tlue to both level of prior mathematics preparation and .instructional * 
method! The me^an semester examination scbre for the sel f-paced 'method was 
99.72'^as compared to 82.28 for. the conve_ntiopal method.' Furthermore, a 
significant prior math^tics preparation x instructional method interaction 
was also indicated. This latter finding suggests that, while the self-paced 
method demonstrated a signif^icant overall improvement" in exacni nation' achieve- ^ 

^ent over the conventional methocVi the effects were not constant across all - . 
levels of prior ma tttematic5 preparation. Investigation of the slopes of 
the regression lines for each instructional method indicated that the effects 
of the self-paced method were most pronounc€td for students^ at if^ rela^ti veTy 
lowest . levels of mathematics preparation and tended to diminish in magnitude 

•as level of mathematics preparation* increased. - 

A 'supplementary analysts indicated that the range of MPE, scores for 
which statistically significant differences in achievement scores existed » 
between. the two instructional methods was from 5 tcJ 18. Thi s- represented ^ 
approxilnatejy 81.9%- of the distribution of subjects^ MPE scores, ; Above a 
score of' 18 on the MPE the overall mean achievement score. for the self-paced 
method was still somewhat higher (9.44 points) thhn that for the conventional; ^ 
however, theimean difference was hot large enough to be considered Statistically 
significant at the ,.01 level.* . ^ / ' 

Another way of regard ing^^this interaction is by considering the \ 
differences in mean examination sc9res between ^e two ihstructiojial methods 
for ch'fferent ranges of the MPE. For in MPE range of 5 - 12** (below one - 
standard deviation b;eljow the bverall mean) the' mean examination scOre ' 
difference was 29.41 points in fayor ' <)f the self-paced method; for an fIPE 
range of 13 ^ 18 (on^^St-andard de^^awon on either side of the overall mean) 

• the meaa difference was' 13.41 poi^its 1n favor of the self-paced; for an MPE 
r*ange of 19 - 26 i(above one st'andl^rd deviation ibove the overall mean)? the 

/mean difference was 9.44 potuts In lavor of the self-paced rpetho'd. " r r" 

. • • - • , \ , ' / ■ •. 

c • - ■ 

* 

* The reader "fs referred to the Cautionary Note beginning on 
page 10 of the fu.ll report.- 
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Base(l on the availability of -an extensive body of research evidence, 
there -appears 'to be lyfrQjB doubt about the effectiveness of tt)e Personalized 
System of Instruction (PSI) or the If Keller Plan" (Keller, 1968) in improving 
both students* attl^des toward a course and their petrf ormance ^n a variety of 
course. achievement measures.' The. basic features-of PSI courses Include the 
follcJWlng: (a) individual 'student pacing; • (b) i^Lstery of a ynit of matep-iaV 
llrior to proceeding to the next uni\; (c) utilization of student tutors; 
(d) use of study guides tp tmpart critical information; and (e) lectures for 
motivation and stimulation rather tHan ifiv 1ntpart1n<i information (KuHk, Kulik 
and Carmichael, 1974}. Various modifications of these basic characteristics 
have been made in 1/nplementing PSI courses in diverse content areas. 

Born and Davis (1974); Born, GlecJhifl and Davis (1972); Cooper and 
Sreneir" (1971); Greew '(1971) Riner (1972); Roth (1973); Shepard and MacDermot 
(^970) and Witters dnd Kef^ (1972) are all representative studies or Veport? 
which indicate that, wherft:Qmpajfed to conventional lecture approaches, the 
general PSI model produces significantly more positive student attitudes toward 
a course and/or sigriif icantly higher achievement. The results of these 
studies are from a. variety bf jdiscipllRes including psychology, physics, mathe- 
matics and engineering. A comprehensive review of PSI In science t^achtng Is 
provided by Kulik,- Kulik and Carmichael^ (1974). 

On^ potential problem with the stu41es cited above, and Indeed with most 
PSI investigations, is that the/ tr'eat comparative student performance In PSI 
and conventiorjal courses globally. As a result,^ they may mask the presence of 
interactions between^dist4nctive iristructional .treatments^ on the one hand, and 
dif,ferent learner traits and/or aptitudes, on the other. It may be that the 
effects of PSI, 'or any individualized instructional system for that matter, are 
not homogeheous across the full range of aptitude^ or personality orientations 
which the student brings to the course. Thua^ PSI may be most effective for ' 
a subgroup of students at certain levels of a pa^rticular tralf, while conventional 
methods may be more appropriate with iaother subgroup of students at different - 
levels*of the same trait.. For still another subgroup, achievement may be 
unaffected by instructional treatment. , 

• Unfortuneutely, It is only recently that researchers have attempted to^ 
disaggregate the global effects of PSI ^Feroald, et al., 1975) or to relate 
.'Performance In P5I courses to learner traits and/pr abflltles (^e.g. , Johnson ^ 



and eroff, 1975} Born/Gledhtn and Davis, |1972; Morris' and - K1fti6rell , 1972;. 

Austin and Gilbert, 1973 and Kulik-, Kulik and -Milholland, T974). The.cesults' 

of this research are not paPticulaf^y conclusive. ^Some studies indicate that 

lower ability students benefit most," in terms of achievement, from the Kel\er 

Plani others .suggest that the §reater benefits accrue to higher ability 

students, and stilT others suggest that* students in -KI courses improve a 

constant amount in achievement regardless of ability level. Despite their 

equivocal nature, however, the findings* of these studies clearly suggest 

that there may be a significant relationship between prior student a^itudes- 

and achievement, and the effectiveness of the PSI instructional method. The 

purpose of the present .investigation was to examine the effects of the 

« « 

Interaction of prior mathematics preparation and instructional metholii on 
achievement in an introductory calculus course taught , by b^tji PSI 4nd conven- 
tional approaches. 

METHOD 

Course and Treatments " I ^ . • , > , ' 

The- focus of the study was the Tirst semester of a four-semester ^ - 
•i<ntroductory calculus sequence (Math 295) intended for potential science and 
mathematics jtejors. The course typically enrolls over 300 studentTs in the 
first semester. ' A number of sections were offered t6 students in a modified^ 
PSI format (entitled Self-Paced Calculus) which allowed for self-pacing, 
optional attendance at lecture/prcftlem solving sessions, scheduled tutorials 
for individual help and testing, and required mastery of a unit of material 
before proceeding to subsequent units. An additional feature of the course 
was variable credit. .Students were required to earn a minijhum of ^ credit 
hours during the semester (in lieu of the traditional 3 credit hours). No ^ 
specific Jimit was sat on the maximum number of credit .hours, that could b6 
eaftied. The number of credit hours earned was tied to the number of unit 
tfests passed. ^ , ^ 

The conventional method of instruction consisted of three hours of 
lecture/oroblOT solving sessions per week. Approximately 24 students were 
assigned to each class section. The classes were taught by both full-time 
faculty and graduate teaching assistants. Both the Conventional and self- 
paced methods covered* essentially the same content and both. methods used the • 
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same primary textbook: Analytic Geometry aind^ the -Xal cuius ^ 3rd Edition, by 
A. U. Goodman. . •* ' . . • 

Subjects ^ . * V ♦ ' ; - . ^ 

The subjects \n thp study were 248 stiKlents, 60 frqm the self-payp;ed. 
method and 188 from the conventional method. Since all students who took 
the final examination in the self-paced method earned a siemester grade of ^ 
rC or Above (the rest being "drops" or F*s), stMdents receiving a D or F in 
the conventional sections were eliminated fr6m the analysis'. The^drops or 
F grades for the self-;;£aced methocf were 28.6%. This compared to 22;1% of the - 
conventional method receiving a .^ade of D, F or incomplete. ' Of the 60 
studer^s in the self-paced method, 43 earned two credit hours 17 earned* 
three or more credit hours. *^ . ' ^• 

* - • • 

Variables ' * • 

*■* ' — 

In prdjer to study the interaction between student traits and instructional 
methods without, confound#ig tTie effects of the fnetlipd, one needs to measure . 
student traits prior to, or at the very beginning off the course. of instruction. 
Prior to beginning Math 295 each student in the study had completed the ^ 
Mathematics Placement Examination (MPE) (Myerberg and Kelly, 1972). The MPE 
was validated on a;safnple of 1422 students in eleyen undergraduate mathematics 
courses at Syracuse Univ.efsity. It-was found, to correlate' .48 with first- 
semester grades ,in Math. 295. This^compa-red with a correlation of -.45 betwetn 
first semester Math* 295' grades and the Mathematics score of the Scholastic 
-Ap^titude Test. The MPE was used in place of the MSAT because scores on the 
•latter measure were not available for 9II subjects in the study. 

. While the MPE ostensibly measures a student's prfor^lev^l of achievement 
in .mathematics skills, its correlat-^n of .5gwith the MSAT suggests that It is 
quite probably also a measure of mathematics Siptitude. For this reason i^ will 
be regarded in the present study as a measune of prior mathematics preparation, 
definyig this construct as encompass-ing both aptitude and aphievement. ^he 
computed Kuder-Richardson 20 (internal consistency) reliability coefficient 
for the MPr is .84. - ^ ) . 

The dependent variable (course achievement) was an eight-item, 132- 
point, common end-of-semester examination which wvered the eqyjjvalent i^i ^ 



content of th6 first JTght units, or two credit hours^;of materieTl in the- • ' * 
self-paced mthod. ' Tlw test was constructed ^jointly by faculty-^members in • 
both.methods and scored by six independent judges who ha(l no association with 
either the self-paced or conventional sections.*^* Each judge scored only one 
' part of the test^or each student- and was unaware of whi.ch instructional methoci 
any particular student was in. fne spl it-half reliability of the ^mination' i 
adjusted' by the Spearman-Brown formula was .72. ' , , ^ 

. Design and Statistical Analysis ' ' ' ^ ^ 

.Because the self-paced alternative presented students with a dr|fBatica1Ty 
different learning fo»Mnat from conventional methods, faculty wgre opposed 
to students* being assigned to .it ^n the tasis of chance.. Th^s prevented the* 
. randooi^ assignment of subjects to treatments and led to the-^dopt4on of^a 
quasi-experimental atpproach. The quasi-experimfental design employed was a 
. pre- post, non-equivalent control group design (Campbell^ and Stanley,'^ 1963) 
in which the subjects could elect to take the self-paced^ption. Since th^ \ 
^ primary tbreat to internal validity in this design stems from possible self- 

selection bias (e.g; students with higher mathematics preparation electing \ 
to take the self-paced meth^od)*, the (Jesign i,s considerably strengthened .if 
equivalence can, be, demonstrated on pre-treatment variables^hich may have \ 
significant correlation with the dependent variable (Campbell and Stanley, 1963). 

Differences between the conventional and self -paced students in the means ' 
and variances of the MPE were both non-significant. The F ratio for the v * - 
difference between MPE means was 1.15 with 1 and 246 degrees of freetfom ' I 
'Cb > .30), while the ratio^of'the group variances fell within the(upper and 
lower rejectiorv regions 6f the F distribution at £ > .25 (Hays, 1963). ' 
(Note: by statistical convention a.d'ifference is. considered non-significant ^ f 
or Unreliable if it has a greater than .UB*lNeobability of being due to chante.) 
Additionally, pre-enrollment scores on the Activities Index (AI), a 
\^ 12.dimension measure of personality f\eeds were available for 132 students 

ffom the conventional method ahfl 47 students from the self-paced method. 
. The AI is a widely used personality irtlentory consisting of the following 
subscales: Self-Assertion, Audacity-Timidity, Intell6ctiial ^Interests, 
Motivation, Applied Interests, Orderliness, Submissiveness,^6^oseness, 
Fri.endliness, Expressiveness-Constraint, Egoism-Diffidenc^ and Sensuousness. 
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A multivariate. analysis of variance yielded n^n-significant diffjerences between 
the ;self-paced and conventional groups ajong -all twelve personality need, 
scales of the AI, For both males and females the multivariate test'was, 
non-significant. The multivariate P-ratio for males was .360 with «12-and - i » 
U4 degrees of freedom {£ > .6QX.wli1le the multivariate F for females was 
,911 with 12 and Z9 degrees of free'dom { p > .'60). TJius, even though strict 
experimental controls were not'possfble in the study, the self-paced and 
conventional groups, nevertheless,' appear to be quite similar in terms ,!of 
both prior mathematics preparation and a range of personality dii^ensforrs. 

Demonstrating such pre-treatmept equivalence between groups in quasi- 
. experimental designs does not permit the same kinds of causal inferences as' 
do true experiments in which subject's can be randomly assigned. Clearly self-^ 
.selection could HSve created pre-treatment bias in unleasured variablf^ which 
iTiay affect achievement— an unequivocal limitation of the present study, tfowever 
the above^ evidence strongly suggests that self-selection did not create pre-, 
treatment bias across*^* wide r^inge of learner characteristics, including levels 
of prigr mathematics -pr^paration^and personal'motivation. . - # 

, ^Multiple regression analysis with semester e^mination score* as the 
predicted variable was the mode of statistical^ analysis employed. The predictor 
variable^ wer^^^instructional method. Mathematics Placement Exam scqpe<andan 
interaction vector credited by multiplying each student's instructional method 
by his or her Ij^PE score. Instructional - method was effect coded accordin^i to 
Kerlinger. and Pedhazur {1973)* Students .in thfe self-pac^eid method were coded 
1 and students in the conventional method were coded*-!. In computing the ' « 
fhultiple reigres'slofi the effects of instructional method were computed while 
controlling for MPE scores, the effects 'of the MPE wefe computed whiJe 
control Hng for instructional method, and the effects of the MPE x instruc- 
tional method interaction were^^T:remfwted while controlling for both instruc- 
tional method and MPE scores. The critical level of significance for^all 
statistical tests was set at the .01 level. • • . ^ ' 

- RESULTS * . . - 



preliminary analysis was conducted for each instructional method to 
determifJe if the relationsTiip between MPE-scores and semester examination 
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scpres' was linear, pir curyilmeaBr/ both irrstructional methods tl>e test 
for deviation 'froni linearity {KeHipger and Peilha2ur,/1973) was non-signif itant 
(p_>*.10)^ This .siig§?st^lth*t'a^,.-V{near relationship best 'characterized the 
association between* prior mathematics preparation' ana examination achievement; 
^. Table ! shows the results of tKe multiple^regression analysis of semestfer 
exartwhation scores. The total variance §Lc*c>unted| f or by instructional method, 
MPE scpres and the M^E x instructionafl ^.metiiod interaction was- 26-.75r(multrp.Te R 
= .517, F = 29.70 with S-and 244 degrees af freedom, i_< .OOl). Tls the ;tab.1e 
•indicates' the effects due, to level x)f pnior-mathematics preparation and. ^ 
instructional method went both statisticaliy^s-lgnificaftt. The mean semester % 
examination score for the self-^ed me^d was 99.72 as compared -to 82.28 . ' 
for the conventional;^ method. Ff^thennore7\a significant prior mathematics 
preparation x instructional .methiDct^jj^^ was also ind+tated-ralthough/ *' 

the magnitude of this effect was relatively^^smal]^ as indicated by ''the modest ^ 
proportion of variance in examination score's for which it acct^inted. 

.The finding of a significant mathematics^ preparationTc ins^trtfftiqnal ' ' / 
method interaction suggests that, even though the self-paced method demonstrates- 
a •Significant* overall improvement iji examination achievement over the cooven- 
tional method, the effects* are not j:Qnstant across all levels of prior . 
-mathematics prdj^ration. Another vjfSy of conceptualizing ^this interaction is by 
considering the slopes of the lirmar regression lines, wMch, in 'p^rt, reipresept 
-th^' rela,tionsh1p between the MPE andrexaminatipn elchievement Tor each ^nstrtfc-^ 
tional method. (The regression line^r^resent l^e least squares linear fit 
to the data.) If no interaction, is preservt, 1:e., if one method is superior- 
to the. other by a constant amouiit acrose a>l levels of prior ma th€Sna tics 
preparation, the slopes of the regression lines wilTbe parallel. On the 
^other hand, if some interaction is' presfint the effects of instructional method , 
are not constant across all levels of mathematics ^reparati.on and the slopes 
of the regression lines will deviate significantly from parallel .^^ . ^ 

The ^statistically significant Mt^E x .ins true tian(al method interaction ' 
shown in Table 1 indicates that the slopes, of the regression lijies representing 
the relai^ionship between prior .mathematfcs preparation and examinatloft. achieve-' 
mej^ ar^ not parallel. Figure 1 depicts the'letfst squares regression lines 
fitted to the data from both instriKitlonal ^methods. The regression equatidhs 
for the two methods are'jas follows (wheVe X is the score^ on the MPE and is; 
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the scorejm the semester examinatiort): ' ^ ' 

* ' • Conventional r Y .» 2. 609X + 43.276 • ' ' 

Self-Paced : Y'- 0.725X + 88.424 

Although the regression 1-ine for the self-paced method is higher than 
that far the conventiofi'al inethod across the full range "of MPE scores, there 
is a clear indication that the lines are .not parallel. The regression lines 
are furthest apart at the lowest measured levels of prior ma^thematics prepara- 
tion and tend to converge as* level of mathematics preparation increases* This 
^iiggest^ that,' while tfrffe is an overall significant improvement in examination 
acMevement ass.oci|l6d with tbe ;5elf-paced method'^ the- effects of that methofl 
fn .improvtng achievement are rtoft pronoilnced for students at' the relatively . .. 
lowest "levels of mathematics piHSpSration and tend to' diminish in magnitude 
as»^level of mathematics preparation increases. 

Furthermore, as represent^ .in Figure 1, the r#la:tionship between prior ^ 
'mathematics preparation and scores on thesemester examination is considerably, 
stronger for, the conventional than for the self-paced rpethod."^ For every - \ 
increase of one po4nt on the MPE tijpre is an average irfcrejase of ^approximate^ 
2.6 examination score points for the co^nventionSl method.. Th^^orresponded 
to an averajge increase of 0.73 points fcnr the self-paced. A further indication 
of this tendency is shown by the respective correlations between the MPE and . 
^examination achievement for the two instructional methods. The correlation 
in the conventional method was .43.4 as compared to .217 in the self-paced* 
In terms' of the varianc^in examination achievement accounted for by prior 
^mathematics preparation Trie percentag'es were 18.84% ,fn the conventional and 
4.73^ in the self-paced. (Percentage of variance accounted for is determljned 
by squaring the* correlation coefficient. ) ' ^ 

. Regions of Significance and Non-Significance > 

A supplementary analysis was conducted with. a technique developed by 
Johnson and l^eyman (1936) which penrfits the determination of the range of MPE 
scores for which it is reasonable to assube that achievement differences » . 



betw^ the two methods are statistically, reliable or sign^icapt.*, • 

The, basic statistics necessary to conduct the Johnson-Neyman an^^sis . ' 
,are shown in Table 2". The results of the analy^'s indicated that the range . 
of MPE scores for which statistically siflnifi9'ant differences in acjjievefhent - 
/ scores existed between the two instructional methods was from 5 -to 18. This, 
^represented approximately &1.9X of. the distribution of subjects' MPE scores. 
•'Above a scorfe of 18 on the MPE the overall mean aichievement score for the 
seW-paced method* was still somewhat htgher than that for the conventional; 
however* the mean difference was 'not large fenough to be. considered statistically' 
significant at the .01 Ijevel. For the puVpbses ojF the study this range of 
scores on the MPE ^pve 18 has been' termed the region of non-significance, y 
and is depicted in Figure 1 by^the shaded area. The region of non-sighif icarTce 
represented only 18.1% of the tQtal distnbut>on of MPE scores. 

Artother' way of regarding this Interaction is by considering the mean 
differences in examination scores bftween instructional methods for differert^ 
reinges of. the MPE. Table's shows, differences between examination score means, 
for the ranges 5-12,. 13-1&, and 19-26 on the MPE. The range 5-12 represents 
the area below one standard deviation belpV me^in, the range 13-18 
represents one standard deviation , on either sld^of the mean, and the range 
1^-26 represents the area &bOve one standard cfeviation above the mean. As 
the* table indicates, self-paped students tended to have higher mean examination 
^scores .across tbe jfull r*ange of MPE sc6res. However, it is clear that the * 
pf)ost dramatic differjendes Were for students who# MPE scores were below one ^ 
standard 'deviation below the mean, i.e., an MPE score range of 5-12. 

Cautionary Note 

- While the linear re'gressipn lines in Figure 1 represent the most*^ accurate 
.general ctSracterization of the overall data. It will be noted that they are 
not extended beyond the point of Intersection, which^alls within the region 



■ , , • • • 

• ^ *Note: If one assumes- that tf^e 248 students 1n this study represent the. 

total .population of students In^^Math 295 receiving a grade oY C or above, then 

tests ^for statistical slgniflcariCfe are not necessary. However, if the students 

in this, study are regardfed as. a sample generally representative of a population* 
of students who haVe or will .be taking Math 295., then inferential tests of 
'significance are appropriate.^ 



TABL£ 2 • . . ■ ■. 
BASIC STATISTICS FOR JOHNSON-NEYMAN ANALYSIS 



SELF-RACED 
(N=€0) 



CONVENTIONAL " 



MATHEMATICS 

PLACEMENT EXAM • 
_ » 

mean 
s..d. 



15.58 
4.17 



14.95, 
. 3.76 



SEMESTER EXAMINATIOf^ 
SCORES . . 

', mean ^ ^ . ' 

■ '- s.d.' 



- 59.72' 
"13.90 



82.28 
^2.65 



•INTERCEPT 



SLOPE 



88.42 



43.28 
• ?.61 



•ERROR SUM OF 
SQUARES , 



89079.8 



TABLE 3 
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MEAN EXAMINATION SCORE DIFFERENCES. FOR THREE 
RANGES OF MATHEMATfcS PLACEMENT EXAMINATION (MPE) SCORE.S 
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MPE SCORE RANGES 


SELF-PACED 
. ' MEAN ^, •- . 


CONVENTIONAL . 
■ ^ MEAN 


difference 
■ Between, 

■MEANS' 

» — \ 



5 - J2 
BELOW ONE STANDARD 
0EVIATK3N BaOlJ THE MEAN 



' 13 - 18, • 
ONE STANDARD OEVIATION' 
ON tITHER SIDE' OF THE 

• MEAN. 

: above' tfNE STANDARD 
• DEVIAJION A|^E-TH£ MEAN 



98.64 
(N = 14) 



97.28' ^'l 
tN = 3^).', 



■ 106)35 
(N yU) 



• ■ i 

.'69.23 ' 
('N = 48 >. 



83.87- 
(N ^ 109)^ 



96.91. 
(N -31)" 



'29.41 



-13.41 



9.44 



\ 20 
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of non-significance. To dd so ma^ have been sotrewhat misleading in th4t it 
would have indicated 'that the conventional method begins to become superior 
to the self-pacecl (in terms o,f examination achievement) beyond an MPE score of 
24. This Is not ^supported by th^ actual data. Although the two. instructional 
methods do not show statistically significant mean 'examination score differences 
for, t-he total range of MPE stores from. 18-26, if one considers only MPE 
scores ^from 22-26, the'self-paced method shows a substantial mean improveiment . 
"in examination scores-* over the convent*^ ona 1 . "Moreover,, if one computes the 

separate Ifnear regressiiins for both instrijctiorfal methods, while restricting 
" the range of' interest to MPE scores from 19^26, 'the relationship between MPE 
"scores and '^mester examination sdores tends to becdme. strongei^ in the s^- ■• 
paced method and weaVer'-in the^rConventional method. 

Bepause so small a number of cases falls within these restricted ^PE score', 

- ranges, however, the reliability of such findings is highly suspect. It 
would be.extremely risky, therefare, to posit some significant change in the/ 
overall linear cliaraeterizati'on of the data as Jepict'ed in Figure 1. Never- ^ 

^ theles-s, this finding may suggest that additional investigation is warranted 
to determine' the* possibly differential benefits of^he two instructional 
methiDds for students witti the highest- level s of prior mathematics preparation. 
If such an investigation is to provide reliable findings, data Will be required 
from substantially greater numbers of students with high MPE scores than are 
available in this study. . ' ' f 

SUMMARY AND CONCLUSIONS 

When compared to a conventional instructional methoti, t^e self-p^ced methpd 
^as associated with, a SAjbstantiarand- statistically significant overall improve- 
ment in mean semester .examination scores even controlling for leyel of . 
prior mathematics preparation.' The effects of "self-pacpd method in tferms 
of improving achievement, however, were not constant across all levels of pri'or 
mathematics preparation (as measupfi^l by the Mathematics Placement E)j||m1nation). 
The effects of ' the self-paced method were, most pronounced- for students with the 

- lowest levels of prior matbanatics preparation and tended to diminish as level 
of mathematics preparation increased. Up to, and including ari MPE scorrof 18 
the mean ex^inat^dn performance'-^f -self-paced students could be considered a 
statistically significant tmprbvement (£:<<01) over, the "nean exAminat'ion 
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pes|6rmance of conventional students/ This region of statistically significant 
differences encompassed 81 .,9% of the total distribution of 248'Students. For an 
MPE score of 19 or above, .differences in aean examinatio?^ scores between the' 
two treatments could not be said to be statistically significant at p « .01-'- 
although the mean for the self-paced was higher'than that for, the conventional. 

* J^®^^^"*^^^ suggest .that level of prior mathematics preparation has 
a s^fewhat stronger association with, semester examination achievement in. the 
conventional method. than In the self-paced. .The 'Mathematics Placement Examina- 
tion accounted for 18.84% of the variance in semester, examination scores for 
t>ie convent-fonal method. -This compared with 4.73% in the self-paced method. 

'Two gener*^l -hypotheses appear to be warranted by 'the above findings.' First, 
it vKpuld seem that the unique instructional features ^ thff self-paced instruc- 
tional method— in particular %he requirement of demonstrated unit mastery antl 
the provisions for self-pacing— act to reduce the association between prior 
^mathematics preparation and subsequent course achievement. Second, the' analysis 
suggests that with the possible exception, mentioned in the Cautionary Note, 
as level- of prior mathematics preparation decreases fhe effects of 'the se^f- 
paced method in improvin^chievement over the conventional method tends to 
become more pronounced. In short, while the exam performance of the'-self- 
paced students tends to be higher than that of the conventional students across 
the entire range of scores on the MPE, the most dramatic differences exist for 
students at the relatively lowest levels of prior. mathematics preparation. 
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